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C ' Abstract 

^ : 

The principle of maximum irreversible is proved to be a Conse- 
co ■ quence of a stochastic order of the paths inside the phase space; in- 
deed, the system evolves on the greatest path in the stochastic order. 
[ The result obtained is that, at the stability, the entropy generation is 
^p^' maximum and, this maximum value is consequence of the stochastic 
■ order of the paths in the phase space, while, conversely, the stochastic 
, order of the paths in the phase space is a consequence of the maximum 
of the entropy generation at the stability. 
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2 ■ 1 Introduction 

It has been proved that entropy is the quantity which allows us to describe 
the progress of non-equilibrium dissipative process [iP] . Using the maxi- 
mum entropy production principle, MEPP, it has been proved that a non- 
equilibrium system develops following the thermodynamic path which max- 
^ I imises its entropy generation under present constraints [3)14] . Considering the 

\ statistical interpretation of entropy, entropy not only tends to increase, but 

it will increase to a maximum value. Consequently, MEPP may be viewed 
as the natural generalisation of the Clausius-Boltzmann-Gibbs formulation 
of the second law [3]. Moreover, from 1995 to 2007 the principle of maximum 
entropy generation, elsewhere called maximum entropy variation due to ir- 
reversibility or maximum irreversible entropy Sirr, has been proved for open 
systems [HfT3]. The principle of maximum for the variation of the entropy 
due to irreversibility represents a general principle of investigation for the 
stability of the open systems; indeed, it states that: in a general thermo- 
dynamic transformation, the condition of the stability for the open system 
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steady states consists of the maximum for the variation of the entropy due 
to the irreversibility. This statement represents an important result in irre- 
versible thermodynamics because it is a global theoretical principle for the 
analysis of the stability of open systems. The irreversible entropy maximum 
principle represents the physical foundation of the design principle of Na- 
ture; indeed, in phenomena out of equilibrium, irreversibility manifests itself 
because the fluctuations of the physical quantities, which bring the system 
apparently out of stationarity, occur symmetrically about their average val- 
ues and entropy generation represents the physical quantity which allows us 
to describe the stability and the range of the fluctuation around the sta- 
ble states [MlfTB] , It allows us to link the global approach to the statistical 
one when irreversible phenomena occur and to obtain the definition of the 
PA-measure [13] for open systems: it represents the relation between the 
probability measurement in the probability space and real statistical facts. 
Using entropy generation it has been introduced the global thermodynamic 
effect of the action of the forces finding a global expression which links the 
microscopical values to the macroscopical thermodynamic quantities |13] . 

A path information has been defined in connection with the different 
possible paths of chaotic system moving in its phase space between two cells. 
On the basis of the assumption that the paths are differentiated by their 
actions, Wang showed that the maximum path information leads to a path 
probability distribution as a function of action. An interesting result is that 
the most probable paths are just the paths of least action [T7j. This suggests 
that the principle of least action, in a probabilistic situation, is equivalent to 
the principle of maximization of information or uncertainty associated with 
the probability distribution. Here we link this result with the principle of 
maximum entropy generation. The aim of this paper is to introduce the 
stochastic order in the analysis of the probability distribution attributed to 
the different paths of chaotic systems moving between two points in the phase 
space. 

In this paper we prove that the principle of maximum irreversible entropy 
is related to the stochastic order of the paths inside the phase space. To do so, 
in Section 2 it will be introduced the system considered and the relation of the 
entropy generation to the theory of probability, in Section 3 path information 
is linked to irreversible entropy and in Section 4 paths are analyzed using the 
stochastic order. 
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2 The open irreversible system 



In this section it will be defined the system considered |4]. Let us consider 
an open continuum or discrete N particles system. Every i—th element of 
this system is located by a position vector Xj e M^, it has a velocity Xj G M^, 
a mass mj G M and a momentum p = mjXj, with i & [1,N] and p G M^. The 
masses must satisfy the condition: 

N 

rui = m (1) 

i=l 

where m is the total mass which must be a conserved quantity so that it 
follows: 

p + pV • is = (2) 

where p = dm/dV is the total mass density, with V total volume of the 
system and x^ G M'^, defined as x^ = X^ili Vi/^-, velocity of the centre of 
mass. The mass density must satisfy the following conservation law: 

pi + piV ■ Xj = pS (3) 

where p, is the density of the i—th elementary volume V^, with Yl!i=i = V, 
and S is the source, generated by matter transfer, chemical reactions and 
thermodynamic transformations. A dynamical state of particles can be 
specified by the 3A^ canonical coordinates {qj G M.^, i G [1, A^]} and their con- 
jugate momenta {pj G M.^,i G [1, A^]}. The 6A^— dimensional space spanned 
by {(pi, qj) , i G [1, A^]} is called the phase space Q. A point cTj = (pj, qi)jg[i 
in the phase space := {cTj G : 0"i = (pi,qi) ,i E [1, A^]} represents a 
state of the entire A^— particle system [18] . A system with perfect accessibil- 
ity QpA is a pair (fi,n), with 11 a set whose elements tt are called process 
generators, together with two functions 



TT^S (4) 

i-> n'-K' (5) 



TT , TT • ■ > ~ ~ 



where S is the state transformation induced by tt, whose domain T) (tt) and 
range TZ (tt) are non-empty subset of Vt. This assignment of transformation 
to process generators is required to satisfy the following conditions of acces- 
sibility: 

1. Her := {Sa : tt G H, cr G (vr)} = , Vd G fi.- the set Ua is called the 
set of the states accessible from a and, consequently, it is the entire 
state space, the phase spase fl; 
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2. if D (7^")^7^ (tt') y^O^V (tt'V) = (P (tt")) and S^,>^,a = S^nS^iO 
\/a eV (tt'V) 

It follows that a process in fip^ is a pair (vr, cr), with cr a state and tt a process 
generator such that cr is in "D (vr). The set of all processes of flpA is denoted 
by [12]: 

UoQ = {{7i,a) : 71 eU,(r eV{n)} (6) 

If (tt, a) is a process, then a is called the initial state for (tt, a) and Sa is 
called the final state for (7r,(j). A cycle C is a path whose endpoints coin- 
cide. A thermodynamic system is a system with perfect accessibility QpA 
with two actions W (vr, a) G M and H (tt, a) G M, called work done and 
heat gained by the system during the process (vr,cr), respectively [12]. The 
set of all these stationary states of a system QpA is called non-equilibrium 
ensemble [13] . Last a thermodynamic path 7 is an oriented piecewise contin- 
uously differentiable curve in flpA [IZj. The triple {flpA, J^, fJ^PA) is a measure 
space, the Kolmogorov probability space T [13]. A dynamical law r is a group 
of meausure-preserving automorphisms S : QpA ^ ^pa of the probability 
space r [13]. A dynamical system = {flpA, J^, fipA, t) on a measure space 
{flpA, J^, fJ'PA) consists of a dynamical law r on the probability space T [T3] . 

Following Wang, we look at a nonequilibrium system moving in the Q- 
space between two states which are in two elementary cells of a given partition 
of the phase space itself. We use the concept of path of classical mechanics: 
if the motion of the system is regular, or if the phase manyfold has positive 
or zero riemannian curvature, there will be only a fine bundle of paths which 
track each other between the initial and the final cells [17]. These trajectories 
must be the paths minimizing action according to the principle of least action 
and have unitary probability; any other path must have zero probability 
[T7I2T]. For a system in chaotic motion, or when the riemannian curvature 
of the phase manyfold is negative, two points indistinguishable in the initial 
cell can separate from each other exponentially [17] . Then between two given 
phase cells represented there may be many possible paths 7^, G [l,^] with 
u number of all the paths, with different travelling time of the system and 
different probability p^^ for the system to take the path k. This last quantity 
is called path probability distribution [TT] and is defined as follows. Consider 
an ensemble of a large number L of identical systems all moving in the phase 
space from two cells with u possible paths. We observe Lk systems travelling 
on the path 7^, with k G [l,w]. The probability p^^, that the system take 
the path 7^ is defined as usual by p^^ = L^/L. Of course Ylk=iP-yk ~ ^■ 
By definition, transition probability from the two states considered 

jl7j . Wang supposed that the different paths of the non-equilibrium systems 
moving between the phase cells are uniquely differentiated by their action. 
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Considering a chaotic open systems, the action has been expressed as 
follows PITB] : 

A = -Tref [ ASirrdt (7) 



where Tref is the temperature of the lower reservoir, 



rri I rri I ' rri ' rri 

-'ay -'r/ -'a -'a 

is the entropy generation [U imfTS] and t^^ is the travelling time of the 
system along the path, with Qr is the heat source, its temperature, 
the ambient temperature (in general reference temperature, i.e. the least 
reservoir temperature), H is the enthalpy, A^xS = — Sout = / d^xS, with 
Sin entropy which enters into the system [20] and Sout entropy which flows 
out of the system [2U], the kinetic energy. Eg the gravitational energy, W 
the work done and Wiost work lost in irreversibility. 

Starting from a dynamical point of view the statistical expression, for the 
irreversible-entropy variation, has been obtained [13] : 

A9. - 

m 



j f,pA{da)J2d.,E,{a) (9) 



with E (cr) = fint (cr) + inc (c") + fterm (cr) , with 0" states in the perfect acces- 
sibility phase space flpA, ^int (o") internal conservation force, f„c (o") external 
active non conservative force, iterm (c") thermostatic expression and /ip^ is a 
statistics such that it describe the asymptotic behaviour of almost all initial 
data in perfect accessibility phase space VLpa such that, except for a volume 
zero set of initial data a. 

For an open thermodynamic system, it has been proved [1] the princi- 
ple of maximum irreversible entropy as a macroscopic and global approach, 
which generalizes to the open systems the local principle of least entropy 
production [22|23] . giving it a global integration for the open complex sys- 
tems, as largely discussed in [^fTO] : this integration is the consequence of 
the difference in a sign, linking to a maximum principle [1]. This principle, 
called also maximum entropy generation principle, states that the condition 
of stability for the open system is that its irreversible entropy variation ASirr 
reaches its maximum [T2lfT3] : 

5 {ASirr) >Q (10) 

If the paths can be identified only by their actions, then it will be possible 
to study their probability distributions with the information concept and the 
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method of maximum information of Jaynes in connection with our knowledge 
about action. This approach will leads us to a probabilistic interpretation 
of the mechanical principle of Maupertuis and a probability distribution de- 
pending on action. 

3 Path information and irreversible entropy 

Since 1962, Jaynes argued that Gibbs' formalism of equilibrium statistical 
mechanics could be generalised in a statistical inference theory for non- 
equilibrium systems [6]. Moreover, the fluctuation theory has been estab- 
lished for a variety of non-equilibrium systems: this theorem 'relates the 
probability p{cr^t) of observing a phase space trajectory with the whole 
system entropy production rate cta* over time interval At, to that of ob- 
serving a trajectory with entropy production rate of —cxAt, specifically 
p{crAt)/p{~o'At) = Gwi^taAt/ksy [6] which means that the 'probability 
of violation of the Second Law of thermodynamics becomes exponentially 
small as At (or the system size) increases' [B]. Consequently, Jaynes de- 
veloped the non-equilibrium statistical mechanics for the stationary steady- 
state constraint on the basis of maximum entropy; his approach consists of 
maximising the path Shannon information entropy Sj = —^^p^^/lTip^/ with 
respect to p^ of the path 7, with the probability subject to the imposed con- 
straints. According to Shannon, 'the information entropy is the logarithm 
of the number of the outcomes i with non- negligible probability pi\ while 
in 'non-equilibrium statistical mechanics it is the logarithm of the number 
of microscopic phase-space paths 7 having non-negligible probability p^' [6]. 
Jaynes' procedure consists of finding the 'most probable macroscopic path 
realised by the greater number of microscopic paths compatible with the im- 
posed constrained' [B], in analogy with the Boltzmann microstate counting: 
'paths rather then states are the central objects of interest in non-equilibrium 
systems, because of the presence of non-zero macroscopic fluxes whose statis- 
tical description requires considering the underlying microscopic behaviour 
over time' [B] which implies that 'the macroscopic behaviour is reproducible 
under given constraints' and it is 'characteristic of each of the great number 
of microscopic paths compatible with those constraints' [6]. Then, Jaynes 
maximised the information entropy with respect to p^, subject to fixed ini- 
tial configurations of internal energy and mass density d(M, {pj}, t) , with 
p mass density and u specific energy, within the control volume V at the 
time t = and fixed time-averaged configurations of internal energy mass 
flux density F(f„, {fj}) , with fu(x, t) internal energy density and fj(x, t) mass 
flux density. He introduced the Lagrange multipliers A conjugate to d and F 
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and leads to a path distribution and which allows to maximize information 
entropy Sj^max = — J^-yP-y ^^P-y with respect of A. From this last relation the 
entropy generation can be defined as [TTIfTS] : 



irr 




'k 



(11) 



k 



This last relation is the value of the integral in the statistical definition of the 
entropy generation ([9]). It can be also interpreted as the missing information 
necessary for predicting which path a system of the ensemble takes during 
the transition from a state to another. 

4 Paths and stochastic order 

When ^pa{^pa) is finite, then for any integrable function if : VLpa 
the time average {ip)^ on 7 is defined for all paths 7 outside of a set of 
measure (A/"^) = 0. Furthermore {ip)^ is integrable, with {ip)^ 07 = (y?)^ 
wherever it is defined, and with 



Following the Birkoff's ergodic theorem, a measure preserving transforma- 
tion 5 : fipA — ^^PA is ergodic if and only if, for every integrable function 
(y9 : f2p^ — i- R, the time average (v?)^ on 7 is equal to the space average 
ivLpA ^ ^^"^ ^^^^ points a outside of some subset N^p of measure 

l^'PA (•A/'v') ~ 0- Consequently, results of the measurements as the infinite 
time averages of phase functions because they take a long time compared 
to the microscopic relaxation time and, for metrically transitive (= ergodic) 
systems, measurement results are almost always equal to microcanonical av- 
erages. Moreover, the initial states lead to different paths in phase space, so 
the averages depend on the initial state. Let be a dynamical system and 
e = {es} be fixed and non zero. An open system is in £— steady state during 
the time interval T if and only if for all S G ^IpA there exists ^5^1^ such 
that for all t G T it follows: 



As a consequence of this last definition, the probability may fluctuate within 
small bounds and, consequently, dynamical evolution towards steady states 
is allowed. Every probability space F generates probability algebra with the 
cr-complete Boolean algebra B = J-"/ A, where A is the cx-ideal of Borel sets 




(12) 



mr-Cs\<es 



(13) 
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of /ipA- measure zero and the restriction of yUp^ to i3 is a strictly positive 
measure p. Conversely, every probability algebra {B,p) can be realized by 
some Kolmogorov probability space F [13] . The Borel cr-algebra J-^ of subsets 
of the set R of real numbers is the cr-algebra generated by the open subsets 
of M. In a Kolmogorov's set-theoretical formulation, a statistical observable 
is a cr-homomorphism ^ : J-^ — > B. Every observable ^ can be induced by a 
real- valued Borel function tt : i7p^ — i- M by means of the inverse map |24j : 



A real- valued Borel funcion tt defined on ^pa is said real valued random 
variable. Moreover, let it be vr : f2pA — ?■ M a real- valued Borel function such 
that cr (-7- 5 (o") is integrable over flpA with respect to i^pa, the expectation 
value Tiev of S (cr) with respect to fipA is: 



A real- valued random variable vr : fip^ — )■ M on F induces a probability mea- 
surement fipA : J-" — )■ [0, 1] on the state space (J-']r,M) [21]. Considering the 
probability as a property of the generating conditions of a sequence, random- 
ness can be related to predictability and retrodictability (Primas 1999). A 
family (t) : t E 71} is called a stocastic process, which can be represented 
by a family {7 (cr (t)) : t E M} of equivalent classes of random variables ^ (t) 
on F. The point function 7(0" (if:)) is called trajectory of the stocastic pro- 
cess ^ (t). The description of physical systems in terms of a trajectory of 
a stochastic process corresponds to a point dynamics, while its description 
in terms of equivalent classes of trajectories and an associated probability 
measure corresponds to an ensamble dynamics [21]. 

The principle of maximum irreversible entropy (ITU]) , in addition to the 
statistical expression of the entropy generation ( ITT]) , induce a stochastic order 
into the thermodynamic paths in the phase space. Indeed, the principle of 
maximum irreversible entropy allows us to single out the most probable path 
in the phase space, followed by the system in its evolution. Let us consider 
the set {7fc, k G [1, A^]} of possible A^ paths in the phase space. We say that 
7j is smaller than 7^, for all i and j in [1, A^], in the stochastic order, denoted 
by 7» <ST e [1, A^], if 



^ (7^) := 71-^ (7^) := {a G Qpa : tt (a) G 7^} , 7^ G Jr 



(14) 




(15) 



< Pij^^hj e [l,N] 

Considering the relation ( ITT]) it follows: 



(16) 



1 dASj, 



(17) 
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from which we can obtain: 



, 1 dAS„r , 
Pik = exp - 1 

Now, considering that: 

7i <ST 7i, V^, J e [1, N] p^^ < p^^ , Vz, J G [1, N] (19) 

it follows: 

/ 1 OAS,,, \ ( 1 di\Si„ .^|, .,, ,„„, 

'''H " j 1" - 1 j . V>, J e [1. iV] (20) 

from which it can be obtained: 

and, consequently, we can state that: let {7a;, k G [1, A^]} be the set of possible 
paths in the phase space, 7i <st 1j, Vi, j G [1, A^], if and only if 

dASirr dASirr w- ■ ^ r^ An /oo\ 

So we have proved that the quantities — — — are ordered and in stochas- 

dp^. 

tic order, too. In theory of probability, it is well known that two random 
variables X and Y are in stochastic order if there exist a random variable 
Z and functions ipi and tp2 such that X = ipi{Z) and Y = ip2{Z) with 
V'i(^) < ^2iZ) [M]. Then, it follows that the path 7^ G {-fk,k G [1,A^]} is 
smaller than the path 7^ G {'Jk^k G [1,A^]}, for all z and j' in [1,A^], in the 
stochastic order, if it is verified the relation f l2^ . 

For an open thermodynamic system, it has been proved the principle 
of maximum irreversible entropy as a macroscopic and global approach; it 
states that the condition of stability for the open system is that its irreversible 
entropy variation ASirr reaches its maximum (ITU]) [T^lfT^ . but, considering 
that: dAS 

S (ASirr) = J2 ~d^^P^^ = + ^'^P^k)dp^k (23) 

k ^'l'* k 

which is a sum of positive or null terms, so that it is positive or null. Conse- 
quently, at the stability the entropy generation is maximum, as the principle 
of maximum irreversible entropy states. So, the maximum of the entropy 
generation is a consequence of the stochastic order of the paths in the phase 
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space. Conversely, from a macroscopic point of view, the stochastic order of 
the paths in the phase space is a consequence of the maximum of the entropy 
generation at the stabihty, and the system evolves on the greatest path in 
the stochastic order. 

In stochastic order some closure properties are proved: here we use them 
in relation to paths. Their proofs are given for random variables in [HI] : the 
paths can be considered as random variables. 

Let {7i, ^ G [1, A^]} and {7.-, z G [1, A^]} be two sets of N paths inside the 
phase space. If 7^ <st I'i^'^i G [1, A^] then: 

N N 

Y.^^<stY.< (24) 

i=l i=l 

SO the stochastic order of paths is closed under convolutions. Moreover, if 
the set {7j,i G [1,A^]} is restricted to the stochastic constrain Y such that 
[ijW] <ST bfcly], Vj, A; G [1,A^] then the stocastic order of paths is closed 
under mixture. 

Last, considering the relation (fT8|) and comparing it with the one obtained 
by Wang [I9]: 

P7fc = gexp(-r7^^J (25) 
we can obtained the expression for the quantities Q and r^; indeed, it follows: 

Q = 5^exp(-r/^^J = e (26) 
fe=i 

and 

1 dASirr 

^ = ir-A — J5 — (27) 



From these two last relations it follows that: 



k=l 



which allows us to obtain a physical link from the mathematical quantities 
and the physical ones. 



5 Conclusions 

The aim of this paper is to introduce the stochastic order in the analysis of 
the probability distribution attributed to the different paths of chaotic sys- 
tems moving between two points in the phase space. If there is no chaos, the 
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path information vanishes and there is between two phase cells only a fine 
bundle of parallel paths which are the paths of least action with unitary prob- 
ability of occurrence. In the other hand, if the system under consideration 
is chaotic, there are possible paths with different actions, and consequently 
there is information. So, following Wang [19], we conjecture that the path 
information may be used as a measure of chaos. 

Summarizing, a path information is defined for an ensemble of possible 
paths of chaotic systems moving between two cells in phase space. It is shown 
that, if we suppose that the different paths are physically identified by their 
actions, the maximization of the path information leads to a path probabil- 
ity distribution as a function of the action. This result, just obtained by 
Wang himself, has been related to the maximum entropy generation princi- 
ple. More, it has been proved that the probability itself is a function of the 
first derivative of the entropy generation. 

Last the stochastic order is introduced in the thermodynamic approach 
for the open chaotic systems, obtaining that, at the stability, the entropy 
generation maximum is consequence of the stochastic order of the paths in 
the phase space, while, conversely, the stochastic order of the paths in the 
phase space is a consequence of the maximum of the entropy generation at 
the stability. It has been proved that the system evolves on the greatest path 
in the stochastic order. 
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